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Abstract 

We study the error probability performance of rotated lattice constellations in frequency-flat Nakagami- 
m block-fading channels. In particular, we use the sphere lower bound on the underlying infinite lattice 
as a performance benchmark. We show that the sphere lower bound has full diversity. We observe that 
optimally rotated lattices with largest known minimum product distance perform very close to the lower 
bound, while the ensemble of random rotations is shown to lack diversity and perform far from it. 
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I. Introduction 

In this letter, we study the family of full rate multidimensional signal constellations carved from 
lattices in frequency-flat Nakagami-m fading channels with degrees of freedom. In particular, 
we consider the uncoded case, i.e., no time redundancy is added to the transmitted signal. 
Current best constellations are designed to achieve full diversity and maximize the minimum 
product distance [1], [2], [3]. To date, there exists no benchmark to compare the performance of 
rotated lattice constellations. Recent work ([4]) gives an approximation to the error probability 
of multidimensional constellations in fading channels, which is not tight and does not always 
have full diversity. 

In this letter, we use the sphere lower bouncO (SLB), as a benchmark for the performance 
of such uncoded lattice constellations. The SLB dates back to Shannon's work [6], and gives 
a lower bound to the error probability of spherical codes with a given length in the additive 
white Gaussian noise (AWGN) channel. The application of the SLB to infinite lattices and 
lattice codes was studied in [7], [8] for the AWGN channel. This SLB yields a lower bound 
to the error probability of infinite lattices regardless of the lattice structure. An approximated 
SLB was derived in [9] for spherical codes over the Rayleigh fading channel. Fozunbal et al. 
[10] extended the SLB to coded communication over the multiple-antenna block-fading channel. 
A remarkable result of [10] is that, for a fixed number of antennas and blocks, as the code 
length grows, the SLB converges to the outage probability of the channel with Gaussian inputs 
[11]. Unfortunately, the outage probability [11], [12] and the SLB of [10] are very far from 
the actual error probability of uncoded multidimensional constellations. Moreover, as the block 
length increases, the performance of uncoded modulations degrades, and therefore, the outage 
probability and the SLB of [10] are not very useful as performance benchmarks. 

In this letter, we use the SLB of the infinite lattice as a benchmark for comparing multi- 
dimensional constellations in the block-fading channel. We first show that the SLB of infinite 
lattice rotations for the block fading channel has full diversity regardless of the block length. 
We illustrate that as the block length increases, the SLB increases as well. We also show that 

'Literature commonly refers to such bound as sphere-packing bound. In order to avoid possible confusion with lattice 
terminology, we will refer to it as sphere lower bound, since its computation is not based on the packing radius of the lattice 
[5]. 
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multidimensional constellations obtained by algebraic rotations with largest minimum product 
distance obtained from pairwise error probability criteria [1], [2], [3] perform very close to the 
lower bound and that the ensemble of random rotations does not achieve full diversity. 

II. System model 

We consider a flat fading channel whose discrete-time received signal vector is given by 

yf = Hx^ + Z£, i = l,---,L (1) 

where G is the A^-dimensional real received signal vector, G is the A^-dimensional 
real transmitted signal vector, H = diag(h) G R^^^, with h = (hi, . . . , Hn) G R^, is the flat 
fading diagonal matrix, and z G is the noise vector whose samples are i.i.d. ~ A/'(0, cr^) 
with pdf 

(II 112 
Z 

We define the signal-to-noise ratio (SNR) as p = 1/cr^. A frame is composed of L, A^-dimensional 
modulation symbols or of NL channel uses. The case of complex signals obtained from 2 
orthogonal real signals can be similarly modeled by © by replacing L with L' = 2L. 

We assume that the fading matrix H is constant during one frame and it changes independently 
from frame to frame. This corresponds to the block-fading channel with blocks [12]. We 
further assume perfect channel state information (CSI) at the receiver, i.e., the receiver perfectly 
knows the fading coefficients. Therefore, for a given fading realization, the channel transition 
probabilities are given by 

p(y|x, H) = {2Txa^y^ exp [~^\\y " Hx|| 

Moreover, we assume that the real fading coefficients follow a Nakagami-m distribution 



Ph{x) = e ™" 

1 m 



where m > □ and 

-+00 



Tix)= / e-^e-'dt 





^The literature usually considers m > 0.5 [13]. However, the fading distribution is well defined and reliable communication 
is possible for any < m < 0.5. 
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is the Gamma function [14]. We define the coefficients 7„ = /i^ for n = 1,...,N, which 
correspond to the fading power gains with pdf 



^m^m 1 



and cdf 



respectively, where 



r(m) 



P-yix) = 1 — r(mx, m), 



— A 1 r~^°^' 



is the normalized incomplete Gamma function [14]. By analyzing Nakagami-m fading, we can 
recover the analysis for a large class of fading statistics, including Rayleigh fading by setting 
m — 1 and Rician fading with parameter K by setting m—{K + 1)^/ {2K + 1) [15]. 

A. Multidimensional Lattice Constellations 

We assume that the transmitted signal vectors x belong to an A^-dimensional signal constella- 
tion S C M^. We consider signal constellations S that are generated as a finite subset of points 
carved from the infinite lattice A = {Mu : u e Z^} with full rank generator matrix M e M^^^ 
[5]. For normalization purposes we fix det(M) = 1. For a given channel realization, we define 
the faded lattice seen by the receiver as the lattice A' = {M'u : u e Z^}, whose generator 
matrix is given by M' = HM. 

In order to simplify the labeling operation, constellations are of the type S = {Mu + xq : 
u e I'm}' where Zm = {0,1,...,M — 1} represents an integer PAM constellation, log2(M) 
is the number of bits per dimension and Xq is an offset vector which minimizes the average 
transmitted energy. Therefore, the rate of such constellations is i? = logs ^ bit/s/Hz. This is 
usually referred to as full-rate uncoded transmission. 

In order to avoid shaping loss it is convenient to use cubic lattice constellations [1], [2]. This 
implies that M should be an orthogonal matrix (MM^ = I) . Nevertheless, this is not required 
in the calculation of the SLB. 

B. Maximum Likelihood Decoding Error Probability 

At a given £, a maximum likelihood (ML) decoder with perfect CSI makes an error whenever 

lly^ - Hw||^ < lly^ - Hx||^ 
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for some w E S, w 7^ x. These inequalities define the so called decision region around x (see 
Figure [T]). Under ML decoding, the frame error probability is then given by 

Pf(p) = E[Pf(p|h)] = E [1 - (1 - P.(p|h))^] (2) 

where Pf(p|h) and Ps(p|h) are the frame and A^-dimensional symbol error probabilities for a 
given channel realization and SNR p, where the average is taken over the fading distribution. 
For a given constellation S, we can write that 

Ps(p|h) = E[p,(p|x, h)] = -^j2 f 

where V(x, h) is the decision region or Voronoi region for a given multidimensional lattice 
constellation point x and fading H. Computing the regions V(x, h) and the exact error probability 
is in general a very hard problem. In this paper we use the SLB [6] as a lower bound on Pf. 
We define the diversity order as the asymptotic (for large SNR) slope of Pf in a log-log scale, 

<,= _,„n!2f^. (3) 

p^oo log p 

The diversity order is usually a function of the fading distribution and the signal constellation S. 
In this paper, we show that the diversity order is the product of the signal constellation diversity 
and a parameter of the fading distribution. In particular, we say that a constellation S has full 
diversity if the ML decoder is able to decode correctly in presence of — 1 deep fades. 
III. Sphere Lower Bound of a Faded Lattice 

In this Section, we recall the basics of the SLB for infinite lattices S = A [7], [8] and we 
apply it to bound P{{p). The first simplification stems from the geometrical uniformity of lattices, 
which implies that [7], [8] 

V(x, h) = V(w,h), Vx, wgA,X7^w 

namely, for a given fading realization, the Voronoi regions of all lattice points are equal. Let 
VA(h) denote such Voronoi region of the faded lattice. Therefore, and without loss of generality, 
we safely assume the transmission of the all-zero codeword, i.e., x^ = , i = 1, . . . , L. Then, 
the error probability is given by [5] 



Pf(p) = 1 - E 



(1- [ p{z)dz) 



L 



(4) 
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Due to the circular symmetry of the Gaussian noise, replacing VA(h) by an A^-dimensional 
sphere B{h) of the same volume and radius -R(h) [6], yields the corresponding SLB on the 
lattice performance [7], [8] 

\ ^ 

p{z)dz 



Pfip)>PsM = l-E 



z^B(h) 



(5) 



Since the volume of B{h) is [5] 

vol(i3(h)) ^ 

equating it to the fundamental volume of the lattice (volume of the Voronoi region) given by 

N 

vol(VA(h)) = det(HM) = JJ /in 

n=l 

yields the sphere radius 

fl(h)^ = ir(^ + i)"Jn^'..) • 

The probability that the noise brings the received point outside the sphere in ([5]) is simply 



expressed as [6], [7], [8] 



Psib(p) = 1 - E 



(7) 



We are now ready for the following result, whose proof is given in the Appendix. 

Theorem 1: In a Nakagami-m block-fading channel with fading blocks, the SLB on the 
error probability given in (|7]) has diversity order d = mN for any L > 1, i.e., full diversity. 

The previous theorem asserts that the best lattice in a channel with fading blocks cannot 
have diversity larger than mN , showing that the overall diversity order is the product of the 
channel diversity m and the maximal signal constellation diversity A^. This result is non-trivial, 
and very important for constellation design. Pairwise error probability analysis yields that full 
diversity lattices can achieve full diversity [1], [2], [3], but no converse based on the lattice 
structure has been proved so far for any L. Clearly, if we construct our signal constellation S 
as a subset of points of an A^-dimensional lattice, S cannot have diversity larger than m times 
the lattice dimension A^. 

In order to evaluate ([7]), we need to perform a multidimensional numerical integral over the 
joint distribution of the vector 

7 = (7i,---,7iv). 
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However, by carefully observing the expression of i?(h)^ given in we can see that we only 
need to know the pdf of the product of fading coefficients. It is not difficult to show that the 
characteristic function of the random variable 



For > 1 a closed form inverse transform of this function is not available, but we can 
nevertheless compute the pdf P(^{z) numerically by using an inverse fast Fourier transform (FFT). 
As an example. Figures [2] show the SLB for L = 1 for various values of N and m. As anticipated 
by Theorem [H the curves get steeper as m or increase. Moreover, Figure [3] shows the SLB 
for L = 1, 10, 100, 1000 and various values of and m. For a given and m, all curves have 
the same diversity. Observe that as L increases the SLB increases, in contrast to what happens 
in the coded case, where as L increases, the SLB converges to the outage probability of the 
channel, as demonstrated in [10]. We note that the SNR p = l/a^ is relative to the infinite lattice 
with vol(A) = 1, since the average transmitted energy cannot be defined. 



In this section, we give a number of examples that use the SLB as a benchmark for comparing 
some lattices obtained by algebraic rotations, as explained in section ULAI In particular, we will 
use the best known or optimal algebraically rotated lattices in terms of largest minimum 
product distance [1], [2], [16], [3]. As we shall see, these rotations perform very close to the 
lower bound. Furthermore, we will show that the ensemble of random rotations does not have 
full diversity. This highlights the role of specific constructions that guarantee full diversity and 
largest minimum product distance for approaching the SLB. 

To illustrate this. Figures HI [5l |6] and |7l compare the frame error probability -Pf(p) of optimal 
rotations with largest minimum product distance (see [1], [2], [16] for more information on 
optimal constructions) obtained by simulation of the infinite lattice using a Schnorr-Euchner 
decoder [17] with the Psib(p)- The corresponding rotation matrices are also available in [sj^. 

^Remark that the rotations in [3] are given in row format as in [5] and that here we use the column convention for lattice 
generator matrices. 




is given by (see Appendix B for details) 




(8) 



IV. Performance of rotated lattices 
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In particular, Figure |4] compares the performance of the cyclotomic rotation for N = 2 and 
L = 1, 100 and m = 0.5, 1,2. Figures [6] and |7] show the SLB and the optimal rotations for 

= 4, 8, namely the Kriiskemper and cyclotomic rotations respectively [1], [2], [16]. As we 
observe, optimal rotations are very close to the SLB. As N increases, algebraic rotations with 
largest minimum product distance show some gap to Psib(p)- This is due to the fact that for 
large N, the minimum product distance is not the only relevant design parameter for optimizing 
the coding gain. Without any loss of generality in the presentation of our results, from now on, 
and unless otherwise specified, forthcoming examples will be shown for m = 1. 

Figures |5(a)[ [6] and |7] also compare by simulation the performance of the aforementioned full- 



diversity algebraic rotations with the average performance of the ensemble of random rotations. 
To compute it, at every frame we generate a random matrix A with zero mean and unit variance 
i.i.d. Gaussian entries. We then perform a A = QR decomposition and let M = Q. This is 
the simplest way of generating the ensemble of random rotations (orthogonal matrices) with the 
Haar distribution [18], [19]. As we observe, algebraic rotations perform very close to Psib(p)- 
On the other hand, the average error probability over the ensemble of random rotations, lacks 
of the full diversity and shows bad performance. To better understand this behavior. Figure |5(b)| 
shows the simulated performance of 30 random samples of the Haar ensemble for = 1 and 
L = 1, compared to the SLB (thick solid line), performance of the cyclotomic rotation (circles) 
and the ensemble average (thick dashed line). We observe that almost all instances have full 
diversity (though with very different coding gains). However, the ensemble average performance 
is dominated by bad rotation matrices. In particular, a closer look to the two worse curves reveals 
that the corresponding rotation matrices are very close to the identity, achieving effectively no 
rotation nor diversity. Furthermore, we observe that as increases, the performance of random 
rotations improves, despite showing a different asymptotic slope. This is due to the fact that for 
large A^, there is a lot of diversity in the channel and the error probability curves get very steep. 
This means that for large A^, random rotations will perform well for low-to-medium SNR. 

V. Performance of multidimensional signal sets 

Practical systems use finite signal alphabets and the performance of the infinite rotated lattice 
should serve mainly as a guideline. Unfortunately, we do not have a bound similar to Psib(p) for 
the finite case to take into account the boundary effects. We conjecture that the best multidimen- 
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sional signal set using M-PAM is the one that has generator matrix M such that Pf (p) is closest 
to Psib(p) for large enough p. As we shall see in the following example, as M increases, the 
performance of the multidimensional signal constellation approaches that of the infinite rotated 
lattice, despite the boundary effects. This is precisely the continuity argument used in [8] for 
lattice codes. Indeed, Figures [H |9] and [10] show the performance for = 2, 4, 8 and L = 1, 100 
of the signal constellations obtained from Af-PAM with the optimal algebraic rotation. In the 
comparison with the infinite lattice (circles) and PsVo{p), we observe all curves are within 1.5 
dB. Note that the SNR axis does not take into account the different average energies of the finite 
constellations and that we assume that the minimum distance of the M-PAM is 1 for comparison 
to the infinite lattice lower bound. In order to plot the performance in terms of ^ = it is 
enough to shift the curves by 



In this paper we have studied the performance of multidimensional rotated lattice constella- 
tions. We have applied the sphere lower bound for the infinite lattice to the block-fading channel 
and proved that the bound has full diversity. We have shown that optimally rotated algebraic 
lattices perform very close to the bound, while the average over the ensemble of random rotations 
does not. Furthermore, we have shown that finite constellations obtained from the rotation of 
{M— PAM}^ constellations perform close to the bound as M gets large. We have conjectured 
that optimal multidimensional signal sets with M-PAM constellation are obtained from rotated 
lattices whose performance is closest to the sphere lower bound. 




VI. Conclusions 
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Appendix A: Proof of Theorem [H 

The exponential equality = and inequalities > and < were introduced in [20]. We write 
f{z) = to indicate that lim^^oo ^"fog^^ ~ exponential inequalities > and < are defined 

similarly. The function t{£} is the indicator function of the event £, namely, t{£} = 1 when £ 
is true, and zero otherwise. Following [20], we define the normalized fading gains a„ = — 
It is not difficult to show that the joint pdf of the vector a. = (ai, . . . , a^) is given by, 

' ml \ ^ 

m log p 



T(m) 



e"™ E™=i p-"" p-m e::=i «n _ 



Using the same arguments as in [20], [21], [22] we have that asymptotically for large p 



for OL G M^_, where ]R_|_ are the positive reals including zero. We can express the SLB as, 

L 



PsM = 1 



l-r(y,/3(a; 



p{a.)d(x 



where 



1 _ 1 Y^-'^ 



(9) 



(10) 



is the second argument of the incomplete Gamma function in ([7]) as a function of ex. Since 
< [l — r (y,/3(q:))]^ < 1 we can apply the dominated convergence theorem [23] and write 



lim 

p—*oo 



N 

1-r (-,/?(«; 



Therefore, since 



1 L 



p{cx)dcx 



lim P{cx) 

p— >oo 



lim 

p— >oo 



i-r(-,/5K 



p{a.)da. 



ifEli«n>iV 



(11) 



we have that 



lim r(-, /3(a) 

p^oo \ Z 



1 ifEn=l«n>^ 
ifEn=l«n<iV, 



(12) 



which implies that 



lim 1 — 

p^oo 



-fN 

i-rfy,/3(a; 



1 ifEn=i«n>Ar 



ifEn=l«n<iV 



(13) 
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and means that for any L > 1, the contribution to Psib(p) from cx such that "^^=1 c^n < N is 
negligible for large p. Also, since p(a)=p~™^"=i"", we can write that, for every L >1, 

Psih{p)= [ p{a)da = [ p-^'^-i^-da (14) 

where ^ = |a e : a„ > iv}. Therefore the diversity order of the SLB is given by 

If ( ^ \ 

d — — lim log / exp ( — mlogpY^a^ i da (15) 



We now apply Varadhan's lemma [24] and we obtain that 

N \ ( N 



d = inf I my an>=m inf < > a„ > = mN (16) 
which completes the proof. 



+ ^, n=l ) +1 n=l 
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Appendix B: Distribution of C 
Consider the random variable 7 with pdf 



jyfn^m 1 



Tim) 



for X, m > 0, then the cdf of log 7 can be expressed as 

Pr(log7 < x) = P^(e^) 

= 1 — r(m, me^) 

and the pdf of log 7 is given by 



Tim) 



^m{x—e^) 



00 < X < 00 



The corresponding characteristic function can be written as 



G{f) = E[e-^'2"^^] 
"+00 



-j2T7fx 



m 



r(m) 



where using the change of variables y = me^ yields 



G{f) 







Tim) 



-y 



m-l-j2nf -y 



e ^dy 



m- 



i27r/-l 



Tim) 



-T{m-j2nf). 



Finally, the characteristic function of ( is given by 



Gdf) 



Tim) 



Tim-j2nf) 



N 



(17) 
(18) 



(19) 

(20) 
(21) 



Figure \TT\ shows P(;{z) evaluated numerically. In particular, Figure |1 l(a)| shows the P({z) for 



different values of and m = 1 while Figure [lT(b)| shows P({z) for = 8 and different values 
of m. 
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p(dB) 

Fig. 3. Sphere lower bound Psib(p) for L = 1 (solid), L = 10 (dashed), L = 100 (dashed-dotted) and L = 1000 (dotted) and 
various values of N and m. 
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Fig. 4. Frame error probability Pf (p) and sphere lower bound Psib(p) for N = 2, m = 0.5, 1, 2 and L = 1, 100. 
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(a) Cyclotomic and average over Haar ensemble for L = 1, 100. 




20 25 
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(b) 30 random samples from the Haar ensemble for L = 1. The SLB (thick solid), average 
over random rotations (thick dashed) and Cyclotomic (circles) are shown for reference 



Fig. 5. Frame error probability Pf{p) and sphere lower bound Psib(p) for A'^ = 2, m = 1 and L = 1, 100. 
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Fig. 6. Frame error probability Pf{p) and sphere lower bound Psib(p) for m = 1, N = 4, L = 1, 100 with Kriiskemper 
rotation. 
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